RealSound Interaction: A Novel Interaction Method with Mixed Reality Space by Localizing Sound Events in Real World
نویسندگان
چکیده
We developed a mixed reality (MR) system which merges the real and the virtual worlds in both audio and visual senses. Our new approach “RealSound Interaction” is based on the idea that the sound events in the real world can work as interaction devices with an MR space. Firstly, we developed a sound detection system which localizes a sound source. The system consisted of two types of microphone arrays, fixed type and wearable type. Secondly, we evaluated the accuracy of the system, and proposed three practical usages of the sound events as interactive devices for MR attractions.
منابع مشابه
RealSound Interaction: A Novel Interaction Method Using Sound Events in Real World
We present a unique and novel method using the direction and location of sound events as input or interaction devices into the mixed-reality space. To estimate the direction and location of sound events, we propose and use a wearable microphone array. This paper describes the outline of our system, the interaction methods using the direction and location of sound events, and finally introduces ...
متن کاملInteraction Techniques with Virtual Humans in Mixed Environments
Homogenous Virtual Environments evolved into Mixed Environments thanks to recent Augmented Reality techniques. We have done research on novel interaction techniques in virtual environments exploiting the usage of 3D virtual space. We will briefly present our Augmented Reality set-up for mixed reality experiments and we will analyze two distinct mixed environment case studies, and present two ne...
متن کاملInteractive Theatre Experience in Embodied + Wearable Mixed Reality Space
This paper presents an interactive theatre based on an embodied mixed reality space and wearable computers. Embodied computing mixed reality spaces integrate ubiquitous computing, tangible interaction and social computing within a mixed reality space, which enables intuitive interaction with physical world and virtual world. We believe it has potential advantages to support novel interactive th...
متن کاملPrepared by : Supervisor
The rise of virtual reality and augmented reality provides brand new way of interaction with digital information. However, virtual reality immerses the users in simulated world with scarce connection with the real one. Augmented reality merely overlays virtual objects over real ones with no specific concern about the interaction in between. By understanding the environment, mixed reality is cap...
متن کاملFrom Memoria Futura to i2TV: A Technological Framework and Two Models for New Forms of Cultural Participation and Production in Mixed Realities
The merits of information technology for the archiving of cultural heritage have been long acknowledged. The challenge now is to realise the communicative potential of information technology for the development of new structures. This is exactly the concern of Mixed Realities as communication levels between reality and virtuality, which offer an open space for visions and creative ways of deali...
متن کامل